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Abstract 

A version of "preferential attachment" random graphs, corresponding to linear 
"weights" with random "edge additions," which generalizes some previously consid- 
ered models, is studied. This graph model is embedded in a continuous-time branching 
scheme and, using the branching process apparatus, several results on the graph model 
asymptotics are obtained, some extending previous results, such as growth rates for 
a typical degree and the maximal degree, behavior of the vertex where the maximal 
degree is attained, and a law of large numbers for the empirical distribution of degrees 
which shows certain "scale-free" or "power-law" behaviors. 
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1 Introduction and results 

Preferential attachment processes have a long history dating back at least to Yule |20j 
and Simon [19] (cf. [12] for an interesting survey). Recently, Barabasi and Albert 
[7] proposed a random graph version of these processes as a model for several real- 
world networks, such as the internet and various communication structures, on which 
there has been much renewed study (see PQ, [9], pj~], [15] and references therein). To 
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summarize, the basic idea is that, starting from a small number of nodes, or vertices, 
one builds an evolving graph by "preferential attachment," that is by attaching new 
vertices to existing nodes with probabilities proportional to their "weight." When the 
weights are increasing functions of the "connectivity," already well connected vertices 
tend to become even more connected as time progresses, and so, these graphs can be 
viewed as types of "reinforcement" schemes (cf. |17j). A key point, which makes these 
graph models "practical," is that, when the weights are linear, the long term degree 
proportions are often in the form of a "power-law" distribution whose exponent, by 
varying parameters, can be matched to empirical network data. 

The purpose of this note is to understand a general form of the linear weights model 
with certain random "edge additions" (described below in subsection 1.1) in terms of 
an embedding in continuous-time branching processes which allows for extensions of 
law of large numbers and maximal degree growth asymptotics, first approached by 
difference equations and martingale methods, in [8], [10], [13], |14j . 

We remark some connections to branching and continuous-time Markov processes 
have also been studied in two recent papers. In [18j . certain laws of large numbers 
for the degree distributions of the whole tree, and as seen from a randomly selected 
vertex are proved for a class of "non-explosive" weights including linear weights. In 
[16] . asymptotic degree distributions under super-linear weights are considered. In this 
context, the embedding given here is of a different character with respect to Markov 
branching systems with immigration, and the contributions made are also different, 
concentrating on detailed investigations of a generalized linear weights degree land- 
scape. 

1.1 Model 

Start with two vertices x>\, V2 and one edge joining them-denote this graph as Go- To 
obtain G\, create a new vertex t>3, and join it a random number X\ times to one of v\ 
and V2 of Go with equal probability. For any finite graph G n = {t>i,t>2, • • • ,1^+2}, let 
the degree of each vertex be defined as the number of edges emanating from that vertex, 
and the degree of the jth vertex, Vj G G n be denoted by dj(n) for j = 1, ... ,n+ 2 
and n > (note that in our notation, G n has n + 2 vertices at step n > 0). After 
n + 2 vertices are created, to obtain G n+ \ from G n , create an (n + 3)rd vertex u n +3, 
and connect it a random number X n+ \ times to one of the n + 2 existing vertices 
v 1 , . . . , v n+ 2 with probability 

d J n)+P (1.1) 

of being joined to vertex v i for 1 < i < n + 2 where (3 > is a parameter. We will 
also assume throughout that {Aj}j>i are independently and identically distributed 
positive integer valued random variables with distribution {pj}j>i with finite mean. 
The "weight" then of the ith vertex at the nth step is proportional to di(n) + (3, and 
linear in the degree. 
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We remark this basic model creates a growing "tree" with undirected edges, and 
includes the "one-edge" case of the original Barabasi-Albert process, made precise in 
[8], by setting Xi = 1 and = 0, as well as the u /3 > 0" scheme considered in [13 1 and 
[13] , by taking X, L = \. Also, the "/3 > 1" linear case considered in [18] is recovered by 
taking = 1. 

The aspect of adding a random number of edges {Xj}j>i at each step to vertices 
chosen preferentially seems to be a new twist on the standard model which can be 
interpreted in various ways. The results, as will be seen, involve the mean number 
^2jpj of added edges, indicating a sort of "averaging" effect in the asymptotics. 

We also note, in the case (3 = 0, a more general graph process, allowing cycles and 
self-loops, can be formed in terms of the "tree" model above (cf. [8] and Ch. 4 |llj ) 
where several sets of edges are added to possibly different existing vertices at each step 
preferentially. Namely, let {Lj}i>i be independent and identically distributed positive 
integer valued random variables with distribution {qj}j>i with finite mean, and let 

Li = Ylk=i Lk f° r i > 1. As before, initially, we start with two vertices, and 
and one edge between them. Run the "tree" model now to obtain vertices {wi}i>3 and 
identify sets 

{w 3 ,...,w 2 +Li}, {w 3+Ll ,...,w 2+i2 }, {w 3+Lk l ,...,w 2+Lk }, ... 

as vertices v% , , • • • , > — One interprets the sequence of graphs Gn = 

{v[ L \ . . . , v^ 2 } for n > as a more general graph process where Li sets of edges 
are added at the ith. step preferentially for i > 1. This model has some overlap with 
the very general model given in [10] where vertices can be selected preferentially or at 
random; in [TO], when only "new" vertices are selected preferentially, their assumptions 
become Xi = 1 and {qj}j>i has bounded support (as well as (3 = 0). 

For the remainder of the article, we will focus, for simplicity, on the basic "tree" 
model given through (jl.ip . although extensions to the other case (Li > 1, (3 = 0) under 
various conditions on {qj}j>i are possible. 

1.2 Results 

For n > and j > 1, let 

n+2 

i=i 

be the number of vertices in G n with degree j. Also, define the maximum degree in 
G n by 

M n = max di(n). 

l<i<n+2 

In addition, denote the mean 
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Our first result is on the growth rates of individual degree sequences {dj(n)} n >o 
and the maximal one M n . It also describes the asymptotic behavior of the index where 
the maximal degree is attained. 

Theorem 1.1 Suppose ^°Sj)Pj < 00 > an d let 9 = m/ (2m + (3). 

(i) For each i > 1, there exists a random variable 7$ on (0, 00) such that 

lim '—^7, - = 7i exists a.s.. 

n^oo 77," 

(n^ Further, there exist positive absolutely continuous independent random variables 
{£i}i>i ^[Ci] < °°j an d a random variable V on (0, 00) such that 7, = for 

i > 1. /n particular, for all i,j > 1, 

,. rfi(n) & 

lim ; = — exisrs a.s.. 

n->oo dj{n) £j 

(Hi) Also, when ^2j r Pj < 00 /or an r > 9~ l = 2 + (3/m, then 

M n 

lim — = max7j < 00 a.s. 

(raj Moreover, in this case f^2j r Pj < 00 /or r > 9 ), if I n is the index where 

d In {n) = M n , 

then lim n _ ) . o0 I n = I < 00 exists a.s. 

Remark 1.1 Note that Theorem 11.11 asserts that the individual degrees dj(n) and the 
maximal degree M n grow at the same rate n e , and also the vertex with maximal degree 
freezes eventually, that is it does not change for large n. 

The next result is on the convergence of the empirical distribution of the degrees 
{dj(n) : 1 < i < n + 2}. Let {D(y) : y > 0} be a Markov branching process with 
exponential(l) lifetime distribution, offspring distribution {p 1 - = Pj-i}j>2, immigration 
rate /3 > 0, immigration size distribution {pj}j>i, and initial value D(0) distributed 
according to {pj}j>i (see Definition 12.21 in section [2] for the full statement). Also, for 
y > and j > 1, let 

Pj (y) = p[D(y)=j). (1.2) 
Theorem 1.2 Suppose Y2U^°Sj)Pj < °°; an d define the probability {ftj}j>i by 
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{2m + 13) / p j (y)e~ ( - 2m+ ^ y dy. 







Then, for j > 1, we have 



■Kj, in probability, as n — > 00. 
n 
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Remark 1.2 As a direct consequence, for bounded functions / : N — ► R, 

^ oo oo 

— S ^f{j)Rj(n) — > J '(J)^j) in probability, as n — > oo. 

" J I 3=1 

We now consider the "power-law" behavior of the limit degree distribution {^j}j>i- 

Theorem 1.3 Suppose ^2j>ij 2+ ^' m Pj < oo. Then, for s > 0, we have 
j s 7Tj < oo if and only if s < 2 + (3/m. 

3>1 

Remark 1.3 Heuristically, the last result suggests ttj = 0(j~[ 3+ ^/ m l) as j j oo. In 
the case Xi = xq for xq > 1, (|1.2p can be explicitly evaluated (Proposition 13. 2p to get 
TTj = 0(j'~[ 3 +^/ a;o ]) when j is a multiple of xo- 

The next section discusses the embedding method and auxilliary estimates. In the 
third section, the proofs of Theorems 11.11 11.21 and 11.31 are given. 

2 Embedding and some estimates 

We start with the following definitions, and then describe in following subsections the 
embedding and various estimates. 

Definition 2.1 A Markov branching process with offspring distribution {p'j}j>o and 
lifetime parameter < A < oo is a continuous-time Markov chain {Z(t) : t > 0} with 
state space § = {0, 1,2...} and waiting time parameters Aj = iX for i > 0, and jump 
probabilities p(i,j) = for j > i — 1 > and i > 1, p(0, 0) = 1, and p(i,j) = 

otherwise (cf. Chapter III [S]). 

Definition 2.2 A Markov branching process with offspring distribution {p'j}j>o and 
lifetime parameter < A < oo ; immigration parameter < (3 < oo and immigration 
size distribution {pj}j>o is a continuous-time Markov chain {D(t) : t > 0} such that 
D(t) = Z(t) as in Definition 12.11 when = 0, and when /? > 0, 

CO 

D(t) = ^Ziit-TJUTiKt) 
i=0 

where {Tj}j>i are the jump times of a Poisson process {-/V(i) : t > 0} with parameter 
/3, To = 0, and {^(-)}i>o are independent copies of {Z(t) : f > 0} as in Definition 
I2.H with Z (0) = D(0) and Zi(0) distributed according to {Pj}j>o for z > 1 and also 
independent of {N(t) :t>0}. 

Remark 2.1 The condition that the mean number of offspring is finite, Yljp'j < °°i 
is sufficient to ensure that P(Z(t) < oo) = 1 and P(D(t) < oo) = 1 for all t > 0, that 
is no explosion occurs in finite time (cf. p. 105 [5]) 
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2.1 Embedding process 

We now construct a Markov branching process through which a certain "embedding" 
is accomplished. Recall {pj}j>i is a probability on the positive integers. Consider an 
infinite sequence of independent processes {Di(t) : t > 0}j>i where each {Di(t) : t > 0} 
is a Markov branching process with immigration as in Definition 12.21 corresponding to 
exponential(A = 1) lifetimes, offspring distribution {jpf- = Pj-i}j>2 (with p' Q = p[ = 0), 
and immigration parameter (3 > and immigration size distribution {pj}j>i- The 
distributions of {Dj(0)}j>i will be specified later. 
Now, define recursively the following processes. 

• At time 0, the first two processes {Di(t) : t > 0},— 12 are started with -Di(O) = 
^2(0) = 1. Let t_i = ro = 0, and Tj, be the first time an "event" occurs in any one of 
the two processes. 

• Now add a random X[ of new particles to the process in which the event occurred: 
(i) If the event is "immigration," then P(X[ = j) = pj for j > 1. (ii) If the event is the 
death of a particle, then P(X[ = j) = Pj-i for j > 2. Denote X\ as the net addition; 
then P(X% = j) = pj for j > 1. 

• At time n, start a new Markov branching process {D^(t) : t > 0} with D^(0) = 

Xl 

• Let T2 be the first time after t\ that an event occurs in any of the processes {Di(t) : 
t > Ti }j=i,2 and {^3(i — Ti) : t > ri}. Add a random (net) number X2, following the 
scheme above for X%, of particles with distribution {pj}j>i to the process in which the 
event occurred. At time T2, start a new Markov branching process {D±(£) : t > 0} with 
D 4 (0) = X 2 . 

• Suppose that n processes have been started with the first two at to = 0, the third 
at time t%, the fourth at time T2, and so on with the nth at time r ra _2, and with (net) 
additions X%,X2, ■ ■ ■ ,X n _2 at these times. Now, let r n _i be the first time after T n __2 
that an event occurs in one of the processes {Di(t) : t > 0},=!^, {D${t — ti) : t > ri}, 
{D±{t — T2) : t > T2}, . . . , {D n (t — T n -2) ■ t > r n _2}. Add a (net) random number X n ^\ 
of new particles with distribution {pj}j>i (following the scheme above) to the process 
in which the event happened. Now start the (n + l)st process {D n+ i(t) : t > 0} with 
D n+1 (0) =X n -!. 

Theorem 2.1 [Embedding Theorem] Recall the degree sequence dj[n) defined for 
the graphs {G n } near M.l\) . For n > 0, let 

Z n = {Dj(r n -Tj^ 2 ) : 1 <j < ra + 2}, and 
Z n = {dj(n) : 1 <j < n + 2}. 

Then, the two collections {Z n } n>0 and {Z n } n >o have the same distribution. 

Proof. First note that both sequences {Z n } n >Q and {Z n } n >o have the Markov 
property and Zq = Zq = {1,1}. Next, it will be shown below that the transition 
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probability mechanism from Z n to Z n+ \ is the same as that from Z n to Z n+ \. To see 
this note that, at time 0, both -Di(-) and D2(-) are "turned on," and, at time t%, Dz(-) 
is "turned on," and more generally, at Tj, L> j+2 (-) is "turned on." At time r n+ i, the 
"event" could be in Di(-) for 1 < i < n + 2 with probability 

Djijn ~ Ti-i) + P 

in view of the fact that the minimum of n+2 independent exponential random variables 
{Vi}i<i<n+2 with means {/J^T }i<i< n +2 is an exponential random variable with mean 
(Y^4=i Mi) -1 ) an£ i coincides with r]i with probability fJ-i(Y^i=i Mi) -1 for 1 < i < n + 2. 
At that event time T n+ i, D n+ ^(-) is "turned on," that is a new (n + 3)rd vertex is 
created and connected to the chosen vertex v j with X n+ \ edges between them. Hence 
both the degree of the new vertex and increment in the degree of the chosen vertex 
(among the existing ones) is X n+ \. This shows that the conditional distribution of 
Z n+ \ given Z n = z is the same as that of Z n+ \ given Z n = z. □ 

2.2 Estimates on branching times 

We now develop some properties of the branching times {r n } n >i, used in the embedding 
in subsection 2.1, which have some analogy to results in section III. 9 [5] (cf. [1]). Define 
S = 2 + 2j3 and, for n > 1, 

n 

S n = 2 + 2(3 + ^2X^+7113, 
i=i 

where as before X\, . . . ,X n are the independent and identically distributed according 
to {pj}j>i net additions at event times t\, ■ ■ ■ , r n . 

Proposition 2.1 The random variable t\ is exponential with mean Sq . Also, for 
n > 1, conditioned on the o -algebra T n generated by {Dj(t — Tj^) ■ T j-2 < t < 
r n ; Xj}i<j< n , the random variable T n+ \ — r n is exponential with mean S~ . 

Proof. Follows from the construction of the {rj}j>i. □ 
Proposition 2.2 Suppose m = ^2jpj < oo. Then, 




is an L 2 bounded martingale and hence converges a.s. as well as in L 2 . 
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Proof. The martingale property follows from the fact 



Tn = 5^ (Tj - Tj-_l) 

i=i 

and Proposition 12.11 

Next, with cj>(a) = E[e- aXl ] for a > 0, we have the uniform bound in n > 1, 



5 7 _i 



/ 1 



(by martingale property) 



c-2 

^-1 



= E £ 

j'=i 

< E/ (^) 



.re 



< 2+2 ^dx 



< 



00 ^-(2+2/?)*^ 



< OO 



lo 1 - (j){2x)e- x P 

where the finiteness in the last bound follows from the fact that 

x 1 



lim — 

x{Q 1 - <t>(2x)e- x P 2m + 



< 00. 



The a.s. and L 2 -convergence follows from Doob's martingale convergence theorem (c.f. 



Theorem 13.3.9 |6|). 



□ 



Proposition 2.3 Suppose log j)pj < 00, and recall m = YljPj- Let also a = 
(2m + ■ Then, there exists a real random variable Y so that a.s., 

n 

EOL 
- = Y. 
7 

j=i J 

Proof. By Proposition 12.21 there is a real random variable Y' such that, 

n 1 

t ™~5Zq ' Y ' a - s ' 

To complete the proof, we note, as -EpfilogXi] = log j)rjj < 00, by Theorem 
III. 9. 4 [5] on reciprocal sums, that Yl'jLiO-fSj ~ a /j) converges a.s. □ 
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Corollary 2.1 Suppose m = ^jpj < oo. Then, 

(i) r n T oo a.s., as n — > oo. 

^4/so, w/ten ^2(j log j)pj < oo, we have, with a = (2m + (3)~ l , that 

(ii) r n — alogn — > Y := Y — 0:7 a.s., as n — > 00, where 7 is i/ie Euler's constant. 
(Hi) For each fixed e > 0, sup ne<fc<ra (r n — 77. — alog(n//c)) — > a.s., as n — > 00. 

Proof. The first claim follows from Proposition 12.21 and the fact that ^ 1/Sj = 00, 
since by strong law of large numbers, we have a.s. that Sj < j(l/a + l) for large j. The 
last two claims, as Y^j=i Vi ~~ logn — > 7, Euler's constant, are direct consequences of 
Proposition 12.31 □ 



2.3 Estimates on Markov branching processes 

As in Definition 12.21 let {D(t) : t > 0} be a Markov branching process with offspring 
distribution {y/- = Pj-i}j>2> lifetime A = 1 and immigration (3 > parameters, and 
immigration distribution {pj}j>i- 

Proposition 2.4 Suppose YKjl°Sj)Pj < °°> an ^ -^(0) ^ 1? -^[-^(0)] < 00. Recall 
m = Yl JPj ■ Then, 

lim D(t)e~ mt = ( 

converges a.s. and in L 1 , and £ is supported on (0, 00) and has an absolutely continuous 
distribution. 

Proof. Let (3 > 0; when (3 = the argument is easier and a special case of the 
following development. Let = Tq < T% < ■ ■ • T n < • • • be the times at which immi- 
gration occurs, and let 771,772, .. . be the respective number of immigrating individuals 
(distributed according to {pj}j>i)- From Definition 12.21 D(t) has representation 

00 

D(t) = ^2Zi(t-Ti)I(Ti<t) (2.1) 
i=0 

where {Zi(t) : t > 0}j>o are independent Markov branching processes with offspring 
distribution {p'j = Pj-i}j>2, with exponential(A = 1) lifetime distributions, with no 
immigration, with Zq(0) = D(0) and Zi(0) = rn for i > 1, and also independent of 
{Ti}i>o- Under the hypothesis log j)pj < 00, it is known (Theorem III. 7.2 [5]; 
with rate A(^> 2 JPj _ 1) = Y^j>iU + ^)Pj — 1 = m), for i > 0, that 

lim Zi(t)e- mt = Wi (2.2) 

t— »oo 

converges in (0, 00) a.s. and Wj has a continuous distribution on (0, 00). Also under 
the hypothesis that ^2(jlogj)pj < 00, it can be shown (Proposition 12.5( 1 that 

E[Wi]< 00 where W { = sup Zi(t)e" mi , (2.3) 
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and hence convergence in (|2.2p holds in L 1 as well. 

Since {Tj}j>o is a Poisson process with rate /3, and independent of {Zi(t)}t>o, 



E 



-mTi 



i=0 



< 



£[Wi](£[D(0)]+ jT 



1=1 



m + (5 



< oo, 



yielding 



i=0 



e mTi < oo a.s.. 



Hence, noting (|2.2p . (|2.3j) and (|2.5|) . by dominated convergence, 

OO i- 

lim D(t)e- mt = V lim Z^t - TjI(Ti < t)e~ m{t - T ^ 

t— >oo ^— t— >oo 

i=0 L 

OO 
8=0 

converges in (0, oo) a.s.. Also, 

sup D{t)e~ mt 



-mTi 



t>0 



> Wj,e 

i=0 



and hence by (|2.4p and (|2.6p . we get that 



lim D(t)e 

t^oo 



-rat 



( in L 1 . 



(2.4) 



(2.5) 



(2.6) 



(2.7) 



Finally, since {Wi}i>o, {7i}j>i are independent, absolutely continuous random vari- 
ables, C is absolutely continuous as well. □ 



2.4 Suprema estimates 

We give now some moment estimates which follow by combination of results in the 
literature. Let {Z(t) : t > 0} be a Markov branching process with offspring distribution 
{p'j = Pj—l}j>2 an d lifetime parameter A = 1 as in Definition 12.11 with independent 
initial population Z(0) distributed according to {Pj}j>i- Recall m = YljPji an d, from 
dH2D and ([23D, that 

W = lim Z(t)e' mt and W = supZ(t) e - mt . 
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Proposition 2.5 The following implications hold: 

If y^Q'logi)pj < oo then E[W] < oo. 

J>1 

Also, for s > 1, 

if ^2 fPj < 00 tnen -S[^ s ] < °°- 
i>i 

Proof. We will take without loss of generality Z(0) = 1, as the initial value Z(0) 
in both statements of the proposition is assumed to have enough integrability. Then, 
first, as Z(-) is increasing, we have 

W = sup Z{t)e~ mt < e m sup Z(n)e" mn := W . (2.8) 

t>0 n>0 

The process \Z(n) : n > 0} is a discrete-time branching, W — linijj^oo Z{n)e mn 5 
and P(Z(1) = 0) = 0, P(Z(1) = j) < 1 for all j > 1. From Lemma 1.2.6 in Asmussen 
[2], for r > 1, we have, when P(W > 0) > 0, that 

E[W£] < C (l + E[W r \) (2.9) 



for a constant Co- 

From Theorem 1. 10.1 [5] or Theorem 1.2.1 [2], 

P(W > 0) > 0, E[W] < oo if and only if log j)P(Z(l) = j) < oo. (2.10) 

In particular, when ^ j r P(Z(l) = j) < oo for r > 1, P(VP > 0) > 0. 

Also, from Theorem 1.4.4 [2], and the discussion on p. 41-42 [2] (cf. equation (4.15) 
[2]), we have, for r > 1 and two constants C\, C2, that 

d^/P(Z(l)=j) < <C 2 (l + ^/P(Z(l)=i)); (2.11) 

hence, E[W r ] < 00 when X) j r P(Z(l) = j) < 00. 

From Corollary III.6.2 [5] (cf. [3]), for a > 1, b > 0, 

^i a |logi| 6 P(Z(l)=i)<oo if and only if £j a | log < 00. (2.12) 

j>i i>i 

Then, straightforwardly combining (|2.8p - (|2.12p . we conclude the proof. □ 

Let now {D(t) : t > 0} be a Markov branching process with offspring distribution 
{Pj- = Pj-i}i>2 5 lifetime A = 1 and immigration > parameters, and immigration 
distribution {pj}j>i as in Proposition 12.41 with also -D(O) distributed as {pj}j>i- Let 
also 



D := supL>(i)e" 

t>o 



-vat 
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Proposition 2.6 For r > 1, we have 



if ^2f Pj < o° th en E[D r ] < 



OO. 



Proof. When (3 = 0, the statement is the same as Proposition 12.51 When (3 > 0, as 
in the proof of Proposition 12.41 let {Tj}j>i be the times of immigration, and To = 0. 
Note that ^2 i>0 e~ mT% < oo a.s. as the expected value Yli>o(ft/(. m + P)T i s finite. 
From (|2.7p . and Jensen's inequality, we have 



< 



j>0 

E 

j>0 



E^ 

i>0 



r e -mr, 



E 

i>o 



E^ 

j>0 



r e -mTi 



E 



r-1 



Hence, by independence of {Wi}j>o and {T}j>o, for an integer K > r — 1, we have 

K-i 



E[D r ] < E[W^Y, E 



i>0 



-mTi 



E 



From Proposition 12.51 i?[WT] < oo. Also, 



E 



-mTi 



; (E 

i>o 



e -mT 3 



< E[e~ 2mT ^ 2 E 



E 

j>0 



e -m Tj 



2K- 



1/2 



P 



2m + (3 



E 



E 



e - mTj 



2K-\ 1/2 



To finish, we now bound, given Tj is the sum of j independent exponential random 
variables with parameter (3 for j > 1, that 



E 



E 



j>0 



2K-i 



2K 



-mTi, 



(2K)\ Yl E U e 

o<h<-< ha L /=i 

r 2iC— 2 

(2/\ j! ^ / J J ( ->l" n ( - — J '2,, i 

0<jl<-<j 2 j?-l L l=i 



-mT ir -2mT ir 







m + (3 



J2K—J2K-1 
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r 2K-l 



< e *[ n 



0<J1<-<J2JC-1 i=l 

/ 7 > > -!- . ) \ 

< {2K)\( 



m + (3 



m 

is finite for fixed K. □ 

3 Proof of main results 

We give the proofs of the three main results in successive subsections. 

3.1 Growth rates for degrees and the maximal degree 

We first begin with a basic analysis result. 

Proposition 3.1 Let {a n< i : 1 < i < n} n >i be a double array of nonnegative numbers 
such that 

(1) For all i > \, lim n ^ 00 a n> i = ai < oo, 

(2) sup n>1 a n> i < bi < oo and 

(3) YirciiZcobi = 0. 
Then, 

(a) maxi<j< n a n i —* maxj>i ai, as n — ► oo. 

(b) In addition, if dj ^ aj for distinct i,j > 1, there exists Io and Nq such that 
maxi<j< n a n ,i = a n j for n> N . 

Proof. For each k > 1, 



Hence, 
which gives 

Also, for each k > 1, 



lim max a n j = max a j . 

n^oo KKt ' Ki<k 



lim^^maxa^ > lim^ max a n j = max a; 

1>1 ±<1<K 1<1<K 



lim n ^ 00 max a ra j > maxa^. (3.1) 

i>l ' i>l 



max a n i < max a n i + max bi. 

i>l ' Ki<k ' i>k 



Then, 



limn^oo max a n j < max Oj + max bi < max ai + max bi . 

i>l ' l<i<fc i>k i>l i>k 
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Since lim^oo 6j = limj—xxj&j = lim^oo maxj>/% 6j = 0, we have 

linin^oo max a n j < maxa;. (3-2) 

i>l ' i>l 

Now, (|3.ip and (|3.2p yield part (a). By assumption (3), maxj>iOj is attained at 
some finite index Iq, and by assumption (4) this index is unique, giving part (b). □ 



Proof of Theorem II. 1L By the embedding theorem (Theorem 12. ip . to establish 
Theorem 11.11 for the sequence {Z n } n >o, it suffices to prove the corresponding results 
for the {Z n } n >o sequence. 

By Proposition 12.41 and Corollary I2.1f i). 

lim Di(r n - n_ 2 )e- m ^- T ^ = Q 

n—>oo 

converges a.s. in (0, oo) for i > 1. By Proposition 12.31 a.s. as n j oo, 



cxp 



-to 



Y] - 1 exp {mr n } = exp \m( r n - V 



. 2m + /? ^ J J I \ ^ J'(2m + /?) 

-> e mr . 

Further, ^j=i(Vi) ~~ logn — > 7, Euler's constant. Thus, a.s. as n j 00, 

e mr„ n -m/(2m+l3) _^ ^7 e ?ri7/(2m+/3) ._ y /g g\ 

where V is a positive real random variable. Hence, 

Di(r n - Ti_ 2 )n- m /( 2m+ « = A(r„ - r i _ 2 )e- m ( T »- T *- a > e - mT «-' 

X e mr n n -" 1 /( 2m +/ 3 ) 

-» 0e- mri ~ 2 F := fcV, 

a.s. as n | oo, where £j = Qe~ mn ~ 2 is a positive real random variable. This proves 
part (i) with jt = £jV. 

By independence of Tj_2 and {A(*)}t>o> absolute continuity of Tj_2 for i > 3 
(tq = T—i = 0), and Proposition 12.41 it follows that has an absolutely continuous 
distribution with finite mean, proving part (ii). 

To prove part (iii) and (iv), we first note, for each i > 1, that 

A(r„ - r,_ 2 )e- m ^-^) < supAWe"™' := A- 



Let 



in,i = A(T n - rj_ 2 )e mTn for 1 < i < n, and 
h = fte""- 2 for i > 1. 
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For each i > 1, sup n>1 a ni j < hi and a n> i — ► Ci e mTi ~ 2 := a, say. Since J2JLij r Pj < 
oo for some r > 1 (satisfying rm/(2m + (3) = r9 > 1), we have that E(D\) < oo 
(Proposition I2.6| ). By Markov's inequality, for all e > 0, 

P (A > e i m /(2m+/3)^j < £J[^]/(eV m /( 2m+/3 )). 

Hence, by Borel-Cantelli, we have a.s. 

£>i < ei m ^ 2m+p) for all large i. 

Since, by Corollary I2.1f ii). mr^ is on order [m/(2m + 0)\ log k a.s. for large k, and 
e > is arbitrary, it follows that bi = Die~ mTi ~ 2 — > a.s. as i f oo. By Proposition 13. II 
and (|3.3[) . this implies that a.s., 

lim max A(r„ -Ti_ 2 )n- m/{2m+/3) = V max Qe~ mTi - 2 . 
n— »oo l<i<n i>l 

Now we claim {Cie" mr '- 2 }i>i are all distinct, that is P^e""""^ 2 = Cie"™ 7 " 8 " 2 ) = 
^(Cje" m(T ^ 2 " Tl - 2) = Ci) = for any 1 < i < j. This follows from the fact that 
conditioned on ^i_2 (see Proposition 12.11 for definition of T{) the random variables, Qj 
and Tj-2 — Ti-2, are independent with absolutely continuous distributions (when j > 3 
for Tj_ 2 — Tj_ 2 as To = t_i = 0) and are independent of ^. Hence, V maxj>x Qe~ mTi - 2 
is attained at a unique index Iq. Also, as {/ n }n>i are integer valued random variables, 
I n will equal /q a -S- for all large n. □ 



3.2 Convergence of the empirical distribution of degrees 

The following lemma will be helpful in the proof of Theorem 11.21 

Lemma 3.1 Let {X(t) : t > 0} be a continuous-time, discrete state-space, Markov 
chain which is non-explosive, that is the number of jumps of {X(t) : t > 0} in any 
finite time-interval [0,K] is finite a.s. For K > 0, 5 > 0, let 

PK {5) = sup p(\X(t + 6) - X{(t-6) V 0)| > 1 



Then, for all K > 0, 



lim pk(S) = 0. 
<H0 



Proof. Since {X(t) : t > 0} is non-explosive, for any < K < oo, the number 
of jumps N(K) of {X(t) : < t < K} is a finite valued random variable a.s.. Also 
for any j < oo, the jump times (Tj, . . . ,Tj) of {X(t) : t > 0} have a continuous joint 
distribution. These two facts together yield the lemma. □ 

The following result follows from Remark 12.11 and the above lemma. 
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Corollary 3.1 Let {D(t) : t > 0} be as in Definition \2.1X Define, for < s < t, 
D(s, t] = D(t) - D(s) and, forK>0,5> 0, 



Pk(S) = sup P [D((t-d) V0,i + <5] > 1 . 

0<t<K \ ' 

Then for K > 0, 

lim p%(5) = 0. 
<5|0 

Proof of Theorem 11.21 Recall a = (2m + (from subsection 2.2). For ra > 1, 
note that 



Rj(n) 



n+2 



n n 

i=i 

n+2 

11 



-V/(A(r n -Ti_ 2 )=i) 
n 

i=l 
n+2 

(A(r„ - ri_ 2 ) = j) - / (A (a log (n/(t - 2))) = j) } (3.4) 

j n+2 

+ - E { J (A ( al °S ( n /^ " 2 ))) = J") " ft" («log(n/(i - 2))) } (3.5) 

i=l 

+ - E {ft (° lo §( n /^ - 2 ))) - / ft (-° lo §( x )) I ( 3 - 6 ) 
n i=i j ° 

+ / (— alog(x)) dx (3-7) 

JO 

= Ji(n) + J 2 (n) + J 3 (n) + J 4 (n), 

where Jj(n), i = 1, . . . , 4 represent the 4 terms in ()3.4ll3.7p (for notational convenience, 
we use the convention log(n/(i — 2)) = log(n) for i = 1,2 here). The proof is now 
obtained by showing J«(n) vanishes in probability for i = 1,2,3 and observing, after 
change of variables, that 



1 f°° 

J 4 (n) = - / pj(y)exp{-y/a}dy. 
a Jo 



To show that the first term J\[n) goes to in probability, fix e > 0. Note, from 
Corollary O^iii), for 6 > 0, if 



An(S) = < sup \r n - n-2 ~ alog(n/(i - 2))| > S > , 

Lne+2<i<n+2 J 

then, 

lim,5joh m n-*oc P(An(8)) = 0. (3.8) 



16 



Now for ne + 2 < i < n + 2. we have < a log (n/(i — 2)) < —aloge. Hence, from 
the definition of A n (5), we get the following bound on the expectation of a typical 
summand in J\ in this range. 

E(\I (A(r„ - 7i- 2 ) = j) - / (A (a log (n/(i - 2))) = j) \) 

= P (| J (A(r„ - t;_ 2 ) = j) — I (A (a log (n/(i - 2))) = j) | = 1) 

< P(|A(r„-r 4 _ 2 )- A (a log (n/(i- 2)) | > 1)) 

< P ({|A(r n - ri_ 2 ) - A (a log (n/(t- 2))) | > l}n^(«5)) + P(A>(<5)) 

< P({A((a log (n/(i - 2)) - 5) V 0, a log (n/(i - 2)) + 5] > 1} n ^(5)) 

+P(A l (<*)) 

< sup p({D i ((a-5)y0,a + 5]>l}DA c n (5))+P(A n {5)) 

ae[0, -aloge] ^ ' 

= pg e) (<5) + P(A(5)) 

where if(e) = —aloge, and we recall Aj(") is a Markov branching process with im- 
migration with A(0) distributed according to {pj}j>i- Since each summand in J\ 
is bounded (by 1), we have by splitting the sum over indices 1 < i < ne + 2 and 
ne + 2<i<n + 2, the following bound: 

E\Ji(n)\< -{ne + 2) + -{n-ne) \p^ ( J5) + P (A n (5)) 
n n L A W 

Now for fixed e > 0, taking limit as n — > oo first and then over <5 — > 0, we get from 
Corollary and (JSE]) that 

limn^ooE 1 ! Ji(n)\ < e 

and, as e > is arbitrary, that limyj-^oo E\ Ji(n)\ = 0. Hence Ji(n) — > in probability, 
as ra — > oo. 

For the second term J2(n), we have from Markov's inequality that for any e > 0, 
P(\J 2 (n)\>e) 

^ ^ E ( J (A(«log (n/(i - 2))) = j) - Pj .(alog (n/(i - 2)) ) 
< 



n 2 e 4: 



using independence of {A( - )}«>1> an d hence of the summands above. Now, by Borel- 
Cantelli arguments and the method of fourth moments (cf. Theorem 8.2.1 [6]), we get 
•hip) — ► a.s., as n — > oo. 

Finally, by simple estimates, and Riemann integrability of Pj(— a log(x)) (as Pj(-) 
is bounded, continuous), the third term vanishes J^{n) — > 0. □ 
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3.3 Power-laws for limiting empirical degree distribution 

Recall, with respect to the definition of ttj (| 1 . 2 1) . that {D{y) : y > 0} is a Markov 
branching process with exponential(A = 1) lifetime distribution, offspring distribution 
{p'j = Pj—l}j>2j immigration rate j3 > 0, immigration size distribution {pj}j>i, and 
initial value -D(O) distributed according to {pj}j>i- 

Proof of Theorem 11.31 First note, for s > 0, that 

poo 

j>i Jo j>i 

POO 

= (2m + /3) / e^ 2m+ ^E[(D(y)) s }dy. (3.9) 
J o 

By Proposition 12.41 D(y)e~ my — ► ( a.s., and when Ylj>i j 2+/3 ^ m Pj < oo, we have by 
Proposition 12.61 that £ ; [(sup 3/>0 D(y)e~ my ) 2+/3 / m ] < oo. Hence, by dominated conver- 
gence, for s < 2 + /3/m, and a constant C, 

Ce msy < ^[(^(y)) 5 ] KC^e™ 9 . 

Plugging into (|3.9p . we prove the theorem for all < s < 2 + /3/m. Noting ^j>ii S7r j — 
J2j>ij 2+l3 ^ m "n'j for s > 2 + (3/m finishes the proof. □ 

We now evaluate ttj in a special case. The formula, similar to that in [13J and 
section 4.2 [18] . gives the asymptotics mentioned in Remark 11.31 

Proposition 3.2 When X\ = xo for an integer xq > 1, we have for j > 1 that 

2x + (5 t r kx + /3 
nj ~ j + 2x + 2(3 1 = 1 (fc + 2)x + 2/3 

ly/ien j = /xo /or Z > 1 (where the product is set equal to 1 when 1 = 1), and ttj = 
otherwise. Hence, for large j, ttj = 0{j^ + ^^ x °^) when j = Ixq for I > 1, and Hj = 
otherwise. 

Proof. First note as Xj = xo that m = D(0) = xq, and the process D(-) moves in 
steps of xo- Clearly, then ttj = when j is not a multiple of xo- When j = Ixq for 
I > 1, let Aj be the first time the process £>(•) equals j, 

Aj = inf {y > : D(y) = j} < oo a.s. 

Let Bj be the time, after Aj, that the process D(-) spends at j; note that conditioned 
on Aj, Bj is an exponential(j + (3) variable. Then, we write 

f' oo 

nj = (2x + /3) / e- y( ~ 2xo+ %j(y)dy 



= (2x + (3)E 
= E 



/ e -y(2* +P) dy 



e -A j (2x +(S)^ 1 _ g-S^^o+zS)] 
j + P 



E ^ e -A j (2x +f3)-^ 



j + 2x + 2/3. 



2x +/3 -Aj (2x0+^9)1 

J + 2xo + 2/3 J - 

As Xj = xo, for j = Ixq and Z > 2, we have Aj is the sum of I — 1 independent 
exponential random variables with parameters xo + /3, ...,(/ — l)xo + /3, and so 

[ J " l = l(fc + 2)xo + 2/3- 

When / = 1, then A,- = 0, giving ir xo = (2x + 0)/(3x o + 2/3). □ 
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